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ABSTRACT 

This paper reports results of efforts over a ?-year 
period (1960-67) to determine if the Hayes Pupil-Teacher Reaction 
Scale is a reliable, valid unidimensional instrument which may be 
used to measure the attitude of students toward the teaching 
effectiveness of the: s** cache its. Criteria used were 1) each 
respondent's total score describes with at least 90 percent accuracy 
which items were reacted to favorably or unfavorably; 2) the item 
marginals, cr thf> percentage of favorable responses to each scale 
item can be consistently rank ordered from the lowest percentage pro 
through the nig host percentage pro; a fid 3) the scale can be submitted 
successfully to intensity analysis to determine which score 
represented a dividing line between favorable and unfavorable 
attitudes. Test included administration to 1) 1,070 university 

undergraduates who selected and rated one of their best teachers and 
one of their worst; 2) a follow-up with 660 college sophomores; 3) 
2,186 tenth graders in 1u high school s- -using Cornell scale* gram 
analysis and intensity analysis and correlation with principal’s 
ratings or teachers, 4) replication with 1,912 sixth graders in 
schools in seven districts. Conclusions were that the Hayes Scale, 
wnich takes only a few minutes to administot and to analyse, appears 
to provide a reliable, reasonably valid ay to help teachers inor.ove 
their teaching. It also possesses some characteristics of 
unidiifensicnality. (The instrument is included.) (JS) 
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Education has been criticized because it has not developed 
a satisfactory yardstick to measure teaching effectiveness 
(Hechinger, 19bl). A satisfactory measuring instrument is needed so 
teachers may see more clearly wh.it they should do to improve their 
teaching* Harr (194S and 1932) examined many investigations of 
teaching efficiency of the past several decades and found that they 
pay insufficient attention to "The particulars of teaching" and the 
relationship between teacher and student. Gage, Chat ter joe and 
Hunk cl (I960) have found that sixth grade teachers will modify their 
teaching m the light of pupil rating. Kcmmers (I9b3) has concluded: 

M lf 23 or more student ratings arc averaged, they are as reliable as 
the better educational and mental tests available." 

ihe purpose of this study was to determine if the Hayes 
Pupil-Teacher Rcacl ion Scale is a reliable, valid unidimeiisuui.il 
instrument which may be used to measure the attitude of students In- 
ward the teaching effectiveness of their teachers. A satisfactory 
uni dimensional instrument includes these factors: (1) each respoiidcn t * s 

total score describes with at least ninety percent accuracy which items 
were reacted to favorably or unfavorably ; (2) the item marginals, nr 
the percentage of favorable responses to each scale item can he consist- 
ently rank ordered from the lowest percentage pro through tin hi gust 
percentage pro; o 1 { 3) the scale can be submitted successful ?y to 
intensity analysis (Stou f fer ot al,, (1930) to determine which score 
represents a dividing line between favorable and unfavorable attitudes. 
It may also be said vitn 90 percent accuracy that any teacher with u 
higher scoie than another teacher was rated favorably on the srim 
items plus a favorable rating to one or more additional items. In 
other words, teachers may he ranked in a consistent order in terns of 
degrees of effectiveness by use of an unidimension.il instrument. 

Several administrations and refinements in 19b0 :>f the Hayes 
Scale indicated that there are certain desirable behaviors which are 
generally characteristic of good teachers and that these behaviors 
are ; ot generally characteristic of poor teachers (Hayes), lk-re one 
thousand and seventy under graduates at The Pennsylvania Stole 
University so I cell'd and rated one of their best and then one of their 
worst instructors with the following results: 
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Tab 1 e I 



Comparison of 1070 Best and 1070 P' orest Inst rut’inrs 



Ins t rue tors 

Attribute Best Poorest 



Makes objective clear when lie begins and 

maintains interest all the time 987 107, 

Is weak at stimulating thought 37, 6 6 7 

Explanations often not clear 27, 9U2 

Inadequate supporting materials 37 887 

Provides very well for interests, needs, 

and experience level of students 9(>7 9.4 

Uses excellent examples 9 2 7 147 

Instruction is very realistic and 

challenging * 9 77 97 

Abruptly concludes lessons, and 1 often. 

wonder what I should have learned 17 747 



In 1961 a follow-up study with 660 colli go sophomores 
(Mayes, 1963) produced evidence of the unidimens ional ity of the Hayes 
Scale. The item coefficients of reproduci hi ) i l y ranged f rom .87 
to .96. The item marginals or percentage pro could be arranged along 
the following continuum: .26, .44, .55, .63, .71, .76, .83, .89, 

and .93. Intensity analysis (See Figure 1) could he performed and 
this indicated that a score of 5 on the nine items was the dividing, 
line betwon unfavorable and favorable attitudes. 

in 1965-66 the Hayes Scale was administered to some 2186 
lentil grade students in 14 high schools of Pennsylvania (Hayes, Koim, 
and Neiraan, 1966). Here Cornell sralogram analysis (Cult man, 194 7) 
produced an average coefficient of reproducibility of .8? for the 
nine items comprising the Hayes Seale. The average percent for Item 
marginals was .50 and these marglnais or favorable response proportions 
could be consistently rank ordered along a continuum ranging from .24 
to .76. Intensity analysis (Suchman and tail t man, 1947) was again 
successfully performed with attitude scores of one in the fall and 
three in the spring being the dividing points (See Figure 2) between 
favorable and unfavorable attitudes toward the leaching of teachers. 
Coefficients of consistency of .73 wet? obtained for 1683 students 
when there were three weeks between ratings and *67 for 1473 students 
when tliert were 25 weeks between ratings. Mi esc student ratings also 
correlated .35 with principals’ ratings of the teachers. Ninety-four 
percent of the teachers who received the results of pupil ratings 
felt that pupil -teacher ratings should be widely used by high school 
teachers to improve their teaching. 
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MEDIAN INTENSITY PERCENTILE 



Figure 1 



INTENSITY CURVE FOR COLLEGE SOPHOMORES 




MIDPOINT OF CONTENT PERCENTILE 
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MEDIAN INTENSITY PERCENTILE 



Figure 2 



INTENSITY CURVE FOR TENTH GRADE SAMPLE 




MIDPOINT OF CONTENT PERCENTILE 
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Til 1966-67 the Hayes Scale was administered to some 1912 
sixth grade pupils in 48 school buildings and 7 school districts of 
the beautiful Lehigh Valley of Pennsylvania (Hayes , Keini, and Neiman, 
1967). Cornell scalogram analysis resulted in an average roeliirienl 
of reproducibility of .82 for the nine items of the Hayes Scale. Ihe 
average for the item marginals was .50 and they could be arranged along 
a continuum from .26 to .80, Intensity analysis (See figure l) was 
performed satisfactorily in both fall and spring and hath limes any 
score but zero represented a favorable? attitude in the minds of the 
pupils. Coefficients of consistency on various admin i s t rat ions ranged 
from .58 (with 21 weeks between ratings) to .85 (with 5 weeks between 
ratings). The pupils 1 ratings correlated .27 with principals 1 ratings 
of the teachers. The correlation between student attitude toward 
teaching of teachers (as measured by the Hayes Scale) and student 
attitude toward school subjects (as measured by the Keinrners '.’call*) 
was .37 in the fall and .45 in the spring. Ninety percent of the 
teachers who received feedback on their pupil ratings felt that most 
of their pupils accurately rated their teaching. 

In conclusion, it should be noted litat tMc Hayes Scale lakes 
only a few minutes to administer and to analyze and yel it appears to 
provide a reliable, reasonably valid way to help teachers improve their 
teaching. Also, the instrument possesses some characteristics of 
uni dimensional ity . 

The itepis on the Hayes Scale are as follows: 

l. This teacher makes the lesson object ices clear 
in the first few minutes of the class: 

a. Always 

b. Usually 

c. Sometimes 

d. Seldom or never 

9 . She (he) really causes you to think: 

a. Most of the time 

b. Often 

c. Sometimes 

d. Seldom or never 

3. Her (his) explanations are: 

a. Extremely clear and to the point 

b. Very clear and to the point 

c. Adequate, might be better 

d. Often not clear or not to the point 
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Figure 3 



INTENSITY CURVE 'OK SIXTH URADK SAMPLE 




MIDPOINT OF CONTENT PERCENTILE 
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4. Her (His) lesson materials are: 

a. Outstanding 

b. Very good 

c. About average 

d. Definitely below average 

5. Her (bis) lessons provide very well for t lie needs, 
interests, and experience level of students: 

a. Always 

b. Usually 

c. About half the time 

d. Sometimes or seldom 

6. Her (bis) instruction is very realistic: 

a - A 1 v n v « 

b. Often 

i:, Sometimes 

d. Seldom or never 

7. Her (bis) instruction is: 

a. Kxtremely challenging 

b. Very challenging 

c. Somewhat challenging 

d. Not very challenging or usually unchal li nging 

b. She (he) concludes lessons by: 

a. Capably emphasizing the main points 

b. Repeating the main points 

c. Abruptly slopping, but this does not bother me 

d. Abruptly stopping and I often wonder what 1 
should have learned during the period 

9. This teacher uses excellent examples to make ideas do; 

a. Most of the time 

b. Usual ly 

c. About half the lime 

d. Some times or seldom 

The dichotomized scoring keys (Kdwards, 1957) were: 
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Scoring Key Comparison 





1961 


1963-66 


Item 


Penn State 


Tenth tirade 



1966-67 
Sixth Crode 



1 


a 


or 


b 


- 


1 


a 


or 


b 


= 


1 




a 




1 


2 


a 


or 


b 


= 


1 


a 


or 


b 




1 


a or 


b 


= 


1 


3 


a 


or 


b 


- 


1 


a 


or 


b 


= 


1 




a 




1 


4 


a 


or 


b 


= 


1 


a 


or 


b 


- 


1 


a or 


b 


= 


1 


5 


a 


or 


b 


* 


1 






a 


= 


1 




a 


= 


1 


6 


a 


or 


b 


= 


1 






a 


= 


1 




a 


= 


1 


7 


a 


or 


b 




1 


a 


or 


b 


= 


1 


a o r 


1 ) 


= 


1 


8 


a , b 


or 


c 


= 


1 


a 


or 


b 




1 




a 


=• 


1 


9 


a 


or 


b 


- 


1 






a 


= 


1 




a 


= 


1 



ms rginals 
and III. 



A comparison oi cueffiv icr.tr: of **< i prnHnribi 1 i ty and of item 
for the three times of adminis tr.it Ion follows in Cables II 



Table 11 







Coefficients of 


Reproducibi 1 i ty 








1961 


1 965-66 


I960 b 7 




1 1 em 


Penn State 


Tenth tirade 


Si Mil tirade 


1. 


Object ives 


.95 


.88 


.82 


2. 


Thinking 


.91 


.86 


.8 3 


3. 


Exp 1 ana t ions 


.90 


.89 


.83 


4. 


Ha terial s 


.88 


.81 


.87 


5. 


Student Needs 


.91 


.89 


.81 


6. 


Realistic 


.91 


.81 


.80 


7. 


Chal 1 enging 


.94 


.86 


.84 


8. 


Cone 1 vis ions 


.96 


.88 


.76 


9. 


Examples 


.87 


.88 


. 79 




Average 


. 91 


.86 


.82 
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Table III 



Item Marginals (% Vr o Resp onse) 





I tem 


1961 

Penn State 


1965-66 
Tenth Grade 


l y <>(>-<> 7 
Sixth Crude 


7. 


(Challenging) 


.26 


.54 


. 70 


2. 


(Thinking) 




.43 


.77 


4. 


(Materials) 


.53 


.64 


.80 


3. 


( Explanations) 


.63 


.72 


. 26 


5. 


(Needs) 


.71 


.33 


. 'll) 


9. 


(Examples 


. 73 


.39 


. 56 


6. 


(Real in tic) 


.76 


.50 


. 39 


1 . 


(Object i ves) 


.89 


. n 


. 30 


8. 


(Conclusions) 


.93 


.24 


. 36 




Average 


.66 


.50 


. 50 
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